Pandas Profiling Report

Dataset statistics

Number of variables	17
Number of observations	1010805
Missing cells	2221667
Missing cells (%)	12.9%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	131.1 MiB
Average record size in memory	136.0 B

Variable types

Numeric	13
Categorical	3
DateTime	1

Alerts

`year` has constant value "2016"	Constant
`air_temperature` is highly overall correlated with `dew_temperature`	High correlation
`building_id` is highly overall correlated with `floor_count` and 1 other fields	High correlation
`dew_temperature` is highly overall correlated with `air_temperature`	High correlation
`floor_count` is highly overall correlated with `building_id` and 2 other fields	High correlation
`site_id` is highly overall correlated with `building_id` and 1 other fields	High correlation
`square_feet` is highly overall correlated with `floor_count`	High correlation
`year_built` has 606553 (60.0%) missing values	Missing
`floor_count` has 835375 (82.6%) missing values	Missing
`cloud_coverage` has 441620 (43.7%) missing values	Missing
`precip_depth_1_hr` has 187335 (18.5%) missing values	Missing
`sea_level_pressure` has 61585 (6.1%) missing values	Missing
`wind_direction` has 72221 (7.1%) missing values	Missing
`meter_reading` is highly skewed (γ1 = 104.1110474)	Skewed
`meter_reading` has 94070 (9.3%) zeros	Zeros
`site_id` has 53777 (5.3%) zeros	Zeros
`cloud_coverage` has 287476 (28.4%) zeros	Zeros
`dew_temperature` has 16966 (1.7%) zeros	Zeros
`precip_depth_1_hr` has 725745 (71.8%) zeros	Zeros
`wind_direction` has 118183 (11.7%) zeros	Zeros
`wind_speed` has 118759 (11.7%) zeros	Zeros

Reproduction

Analysis started	2025-01-29 02:31:37.512044
Analysis finished	2025-01-29 02:32:00.660037
Duration	23.15 seconds
Software version	ydata-profiling vv4.12.2
Download configuration	config.json

building_id
Real number (ℝ)

High correlation

Distinct	1449
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	798.69003

Minimum	0
Maximum	1448
Zeros	411
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	0
5-th percentile	98
Q1	392
median	895
Q3	1178
95-th percentile	1373
Maximum	1448
Range	1448
Interquartile range (IQR)	786

Descriptive statistics

Standard deviation	426.95913
Coefficient of variation (CV)	0.53457426
Kurtosis	-1.2383161
Mean	798.69003
Median Absolute Deviation (MAD)	349
Skewness	-0.31081893
Sum	8.0731987 × 10⁸
Variance	182294.1
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1259	1833	0.2%
1241	1793	0.2%
1298	1791	0.2%
1294	1765	0.2%
1301	1747	0.2%
1296	1745	0.2%
1249	1744	0.2%
1293	1736	0.2%
1295	1733	0.2%
1232	1723	0.2%
Other values (1439)	993195	98.3%

Value	Count	Frequency (%)
0	411	< 0.1%
1	455	< 0.1%
2	401	< 0.1%
3	442	< 0.1%
4	449	< 0.1%
5	439	< 0.1%
6	429	< 0.1%
7	834	0.1%
8	451	< 0.1%
9	791	0.1%

Value	Count	Frequency (%)
1448	373	< 0.1%
1447	360	< 0.1%
1446	410	< 0.1%
1445	381	< 0.1%
1444	397	< 0.1%
1443	356	< 0.1%
1442	731	0.1%
1441	374	< 0.1%
1440	380	< 0.1%
1439	350	< 0.1%

meter
Categorical

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	7.7 MiB

0	603060
1	208925
2	135057
3	63763

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	1010805
Distinct characters	4
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	2
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	603060	59.7%
1	208925	20.7%
2	135057	13.4%
3	63763	6.3%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
0	603060	59.7%
1	208925	20.7%
2	135057	13.4%
3	63763	6.3%

Most occurring characters

Value	Count	Frequency (%)
0	603060	59.7%
1	208925	20.7%
2	135057	13.4%
3	63763	6.3%

Most occurring categories

Value	Count	Frequency (%)
(unknown)	1010805	100.0%

Most frequent character per category

(unknown)

Value	Count	Frequency (%)
0	603060	59.7%
1	208925	20.7%
2	135057	13.4%
3	63763	6.3%

Most occurring scripts

Value	Count	Frequency (%)
(unknown)	1010805	100.0%

Most frequent character per script

(unknown)

Value	Count	Frequency (%)
0	603060	59.7%
1	208925	20.7%
2	135057	13.4%
3	63763	6.3%

Most occurring blocks

Value	Count	Frequency (%)
(unknown)	1010805	100.0%

Most frequent character per block

(unknown)

Value	Count	Frequency (%)
0	603060	59.7%
1	208925	20.7%
2	135057	13.4%
3	63763	6.3%

timestamp
Date

Distinct	8784
Distinct (%)	0.9%
Missing	0
Missing (%)	0.0%
Memory size	7.7 MiB

Minimum	2016-01-01 00:00:00
Maximum	2016-12-31 23:00:00
Invalid dates	0
Invalid dates (%)	0.0%

Histogram with fixed size bins (bins=50)

meter_reading
Real number (ℝ)

Skewed Zeros

Distinct	309604
Distinct (%)	30.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2103.913

Minimum	0
Maximum	20899900
Zeros	94070
Zeros (%)	9.3%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	18.3
median	78.7501
Q3	268.054
95-th percentile	1579.1
Maximum	20899900
Range	20899900
Interquartile range (IQR)	249.754

Descriptive statistics

Standard deviation	150775.02
Coefficient of variation (CV)	71.664093
Kurtosis	11546.098
Mean	2103.913
Median Absolute Deviation (MAD)	74.8799
Skewness	104.11105
Sum	2.1266458 × 10⁹
Variance	2.2733106 × 10¹⁰
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	94070	9.3%
20	1185	0.1%
2.9307	1173	0.1%
5.8614	1112	0.1%
36.6	1092	0.1%
24.4	1078	0.1%
8.7921	1066	0.1%
30	1053	0.1%
61	1021	0.1%
10	1006	0.1%
Other values (309594)	906949	89.7%

Value	Count	Frequency (%)
0	94070	9.3%
0.0002	2	< 0.1%
0.0003	25	< 0.1%
0.0004	452	< 0.1%
0.0005	1	< 0.1%
0.0006	21	< 0.1%
0.0007	1	< 0.1%
0.0008	1	< 0.1%
0.0009	13	< 0.1%
0.0011	1	< 0.1%

Value	Count	Frequency (%)
20899900	1	< 0.1%
20833700	1	< 0.1%
20224800	1	< 0.1%
20030300	1	< 0.1%
20005400	1	< 0.1%
19669300	1	< 0.1%
19559400	1	< 0.1%
19307100	1	< 0.1%
19211100	1	< 0.1%
19204600	1	< 0.1%

site_id
Real number (ℝ)

High correlation Zeros

Distinct	16
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	7.9857955

Minimum	0
Maximum	15
Zeros	53777
Zeros (%)	5.3%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	3
median	9
Q3	13
95-th percentile	15
Maximum	15
Range	15
Interquartile range (IQR)	10

Descriptive statistics

Standard deviation	5.0983856
Coefficient of variation (CV)	0.63843178
Kurtosis	-1.5254726
Mean	7.9857955
Median Absolute Deviation (MAD)	5
Skewness	-0.04118906
Sum	8072082
Variance	25.993536
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=16)

Value	Count	Frequency (%)
13	135424	13.4%
9	134016	13.3%
2	126975	12.6%
14	125060	12.4%
3	118614	11.7%
15	90319	8.9%
0	53777	5.3%
5	39160	3.9%
4	37272	3.7%
6	33266	3.3%
Other values (6)	116922	11.6%

Value	Count	Frequency (%)
0	53777	5.3%
1	27740	2.7%
2	126975	12.6%
3	118614	11.7%
4	37272	3.7%
5	39160	3.9%
6	33266	3.3%
7	18340	1.8%
8	28292	2.8%
9	134016	13.3%

Value	Count	Frequency (%)
15	90319	8.9%
14	125060	12.4%
13	135424	13.4%
12	15744	1.6%
11	6081	0.6%
10	20725	2.1%
9	134016	13.3%
8	28292	2.8%
7	18340	1.8%
6	33266	3.3%

primary_use
Categorical

Distinct	16
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	7.7 MiB

Education	408361
Office	219318
Entertainment/public assembly	113355
Lodging/residential	107386
Public services	83228
Other values (11)	79157

Length

Max length	29
Median length	24
Mean length	12.328786
Min length	5

Characters and Unicode

Total characters	12461999
Distinct characters	36
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	Lodging/residential
2nd row	Technology/science
3rd row	Education
4th row	Education
5th row	Education

Common Values

Value	Count	Frequency (%)
Education	408361	40.4%
Office	219318	21.7%
Entertainment/public assembly	113355	11.2%
Lodging/residential	107386	10.6%
Public services	83228	8.2%
Healthcare	19909	2.0%
Other	12096	1.2%
Parking	10704	1.1%
Manufacturing/industrial	6161	0.6%
Food sales and service	5786	0.6%
Other values (6)	24501	2.4%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
education	408361	33.3%
office	219318	17.9%
entertainment/public	113355	9.2%
assembly	113355	9.2%
lodging/residential	107386	8.8%
services	88128	7.2%
public	83228	6.8%
healthcare	19909	1.6%
other	12096	1.0%
parking	10704	0.9%
Other values (11)	50560	4.1%

Most occurring characters

Value	Count	Frequency (%)
i	1403088	11.3%
e	1055210	8.5%
n	1005823	8.1%
c	955724	7.7%
t	917140	7.4%
a	839852	6.7%
d	640866	5.1%
u	630658	5.1%
o	549433	4.4%
s	547259	4.4%
Other values (26)	3916946	31.4%

Most occurring categories

Value	Count	Frequency (%)
(unknown)	12461999	100.0%

Most frequent character per category

(unknown)

Value	Count	Frequency (%)
i	1403088	11.3%
e	1055210	8.5%
n	1005823	8.1%
c	955724	7.7%
t	917140	7.4%
a	839852	6.7%
d	640866	5.1%
u	630658	5.1%
o	549433	4.4%
s	547259	4.4%
Other values (26)	3916946	31.4%

Most occurring scripts

Value	Count	Frequency (%)
(unknown)	12461999	100.0%

Most frequent character per script

(unknown)

Value	Count	Frequency (%)
i	1403088	11.3%
e	1055210	8.5%
n	1005823	8.1%
c	955724	7.7%
t	917140	7.4%
a	839852	6.7%
d	640866	5.1%
u	630658	5.1%
o	549433	4.4%
s	547259	4.4%
Other values (26)	3916946	31.4%

Most occurring blocks

Value	Count	Frequency (%)
(unknown)	12461999	100.0%

Most frequent character per block

(unknown)

Value	Count	Frequency (%)
i	1403088	11.3%
e	1055210	8.5%
n	1005823	8.1%
c	955724	7.7%
t	917140	7.4%
a	839852	6.7%
d	640866	5.1%
u	630658	5.1%
o	549433	4.4%
s	547259	4.4%
Other values (26)	3916946	31.4%

square_feet
Real number (ℝ)

High correlation

Distinct	1397
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	107883.35

Minimum	283
Maximum	875000
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	283
5-th percentile	7481
Q1	32766
median	72709
Q3	139683
95-th percentile	327256
Maximum	875000
Range	874717
Interquartile range (IQR)	106917

Descriptive statistics

Standard deviation	117166.73
Coefficient of variation (CV)	1.0860502
Kurtosis	9.9680331
Mean	107883.35
Median Absolute Deviation (MAD)	48066
Skewness	2.6629997
Sum	1.0904903 × 10¹¹
Variance	1.3728042 × 10¹⁰
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
387638	3040	0.3%
150695	2613	0.3%
200933	2303	0.2%
64583	2171	0.2%
42755	2022	0.2%
71088	1833	0.2%
194188	1793	0.2%
53130	1792	0.2%
171084	1791	0.2%
65000	1784	0.2%
Other values (1387)	989663	97.9%

Value	Count	Frequency (%)
283	470	< 0.1%
356	405	< 0.1%
366	408	< 0.1%
387	161	< 0.1%
481	400	< 0.1%
520	383	< 0.1%
648	388	< 0.1%
666	426	< 0.1%
755	373	< 0.1%
801	406	< 0.1%

Value	Count	Frequency (%)
875000	424	< 0.1%
861524	1328	0.1%
850354	439	< 0.1%
819577	434	< 0.1%
809530	425	< 0.1%
764237	1329	0.1%
745671	1272	0.1%
731945	1320	0.1%
679614	927	0.1%
671507	1287	0.1%

year_built
Real number (ℝ)

Missing

Distinct	116
Distinct (%)	< 0.1%
Missing	606553
Missing (%)	60.0%
Infinite	0
Infinite (%)	0.0%
Mean	1968.2895

Minimum	1900
Maximum	2017
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	1900
5-th percentile	1912
Q1	1951
median	1970
Q3	1993
95-th percentile	2011
Maximum	2017
Range	117
Interquartile range (IQR)	42

Descriptive statistics

Standard deviation	30.196599
Coefficient of variation (CV)	0.015341544
Kurtosis	-0.65256433
Mean	1968.2895
Median Absolute Deviation (MAD)	20
Skewness	-0.40611322
Sum	7.9568496 × 10⁸
Variance	911.83461
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1976	26638	2.6%
1964	13154	1.3%
1966	11511	1.1%
2006	9755	1.0%
1968	9435	0.9%
1970	9033	0.9%
2007	8782	0.9%
1975	8672	0.9%
1960	8323	0.8%
1967	8291	0.8%
Other values (106)	290658	28.8%
(Missing)	606553	60.0%

Value	Count	Frequency (%)
1900	2655	0.3%
1902	1091	0.1%
1903	1995	0.2%
1904	1162	0.1%
1905	454	< 0.1%
1906	1275	0.1%
1907	1701	0.2%
1908	1303	0.1%
1909	2527	0.2%
1910	2838	0.3%

Value	Count	Frequency (%)
2017	450	< 0.1%
2016	3492	0.3%
2015	1216	0.1%
2014	5487	0.5%
2013	4783	0.5%
2012	3533	0.3%
2011	3342	0.3%
2010	6971	0.7%
2009	2985	0.3%
2008	2453	0.2%

floor_count
Real number (ℝ)

High correlation Missing

Distinct	18
Distinct (%)	< 0.1%
Missing	835375
Missing (%)	82.6%
Infinite	0
Infinite (%)	0.0%
Mean	4.1877102

Minimum	1
Maximum	26
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	1
median	3
Q3	6
95-th percentile	11
Maximum	26
Range	25
Interquartile range (IQR)	5

Descriptive statistics

Standard deviation	4.0157494
Coefficient of variation (CV)	0.95893679
Kurtosis	8.4288242
Mean	4.1877102
Median Absolute Deviation (MAD)	2
Skewness	2.480698
Sum	734650
Variance	16.126243
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=18)

Value	Count	Frequency (%)
1	46539	4.6%
2	34781	3.4%
4	17722	1.8%
3	16486	1.6%
6	14891	1.5%
5	12745	1.3%
8	8765	0.9%
7	6462	0.6%
9	4308	0.4%
11	3125	0.3%
Other values (8)	9606	1.0%
(Missing)	835375	82.6%

Value	Count	Frequency (%)
1	46539	4.6%
2	34781	3.4%
3	16486	1.6%
4	17722	1.8%
5	12745	1.3%
6	14891	1.5%
7	6462	0.6%
8	8765	0.9%
9	4308	0.4%
10	1675	0.2%

Value	Count	Frequency (%)
26	1345	0.1%
21	1326	0.1%
19	1312	0.1%
16	419	< 0.1%
14	434	< 0.1%
13	2217	0.2%
12	878	0.1%
11	3125	0.3%
10	1675	0.2%
9	4308	0.4%

air_temperature
Real number (ℝ)

High correlation

Distinct	614
Distinct (%)	0.1%
Missing	4815
Missing (%)	0.5%
Infinite	0
Infinite (%)	0.0%
Mean	15.984002

Minimum	-28.9
Maximum	47.2
Zeros	7052
Zeros (%)	0.7%
Negative	77717
Negative (%)	7.7%
Memory size	7.7 MiB

Quantile statistics

Minimum	-28.9
5-th percentile	-2.8
Q1	8.5
median	16.7
Q3	23.9
95-th percentile	32.2
Maximum	47.2
Range	76.1
Interquartile range (IQR)	15.4

Descriptive statistics

Standard deviation	10.93507
Coefficient of variation (CV)	0.6841259
Kurtosis	-0.039492983
Mean	15.984002
Median Absolute Deviation (MAD)	7.7
Skewness	-0.36506475
Sum	16079746
Variance	119.57576
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
24.4	19789	2.0%
25	19538	1.9%
20	19052	1.9%
23.3	18823	1.9%
25.6	18813	1.9%
23.9	18741	1.9%
15	18740	1.9%
19.4	18455	1.8%
21.7	18380	1.8%
22.8	18368	1.8%
Other values (604)	817291	80.9%

Value	Count	Frequency (%)
-28.9	15	< 0.1%
-28.8	1	< 0.1%
-28.7	4	< 0.1%
-28.6	6	< 0.1%
-28.4	2	< 0.1%
-28.3	17	< 0.1%
-28.2	8	< 0.1%
-28	2	< 0.1%
-27.8	52	< 0.1%
-27.5	1	< 0.1%

Value	Count	Frequency (%)
47.2	61	< 0.1%
46.7	23	< 0.1%
46.1	26	< 0.1%
45.6	62	< 0.1%
45	76	< 0.1%
44.4	130	< 0.1%
43.9	288	< 0.1%
43.3	463	< 0.1%
42.8	525	0.1%
42.2	849	0.1%

cloud_coverage
Real number (ℝ)

Missing Zeros

Distinct	10
Distinct (%)	< 0.1%
Missing	441620
Missing (%)	43.7%
Infinite	0
Infinite (%)	0.0%
Mean	1.9025712

Minimum	0
Maximum	9
Zeros	287476
Zeros (%)	28.4%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	0
median	0
Q3	4
95-th percentile	8
Maximum	9
Range	9
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.4056039
Coefficient of variation (CV)	1.2643963
Kurtosis	0.41654081
Mean	1.9025712
Median Absolute Deviation (MAD)	0
Skewness	1.1600784
Sum	1082915
Variance	5.7869302
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	287476	28.4%
2	121174	12.0%
4	92282	9.1%
8	27643	2.7%
6	27399	2.7%
7	6203	0.6%
9	3689	0.4%
1	1278	0.1%
3	1102	0.1%
5	939	0.1%
(Missing)	441620	43.7%

Value	Count	Frequency (%)
0	287476	28.4%
1	1278	0.1%
2	121174	12.0%
3	1102	0.1%
4	92282	9.1%
5	939	0.1%
6	27399	2.7%
7	6203	0.6%
8	27643	2.7%
9	3689	0.4%

Value	Count	Frequency (%)
9	3689	0.4%
8	27643	2.7%
7	6203	0.6%
6	27399	2.7%
5	939	0.1%
4	92282	9.1%
3	1102	0.1%
2	121174	12.0%
1	1278	0.1%
0	287476	28.4%

dew_temperature
Real number (ℝ)

High correlation Zeros

Distinct	519
Distinct (%)	0.1%
Missing	5006
Missing (%)	0.5%
Infinite	0
Infinite (%)	0.0%
Mean	7.7361903

Minimum	-35
Maximum	26.1
Zeros	16966
Zeros (%)	1.7%
Negative	235486
Negative (%)	23.3%
Memory size	7.7 MiB

Quantile statistics

Minimum	-35
5-th percentile	-9.4
Q1	0
median	8.9
Q3	16.1
95-th percentile	22.8
Maximum	26.1
Range	61.1
Interquartile range (IQR)	16.1

Descriptive statistics

Standard deviation	10.169353
Coefficient of variation (CV)	1.314517
Kurtosis	-0.3340013
Mean	7.7361903
Median Absolute Deviation (MAD)	7.8
Skewness	-0.42998524
Sum	7781052.5
Variance	103.41575
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
10	19822	2.0%
13.9	18410	1.8%
22.2	18207	1.8%
13.3	18097	1.8%
12.8	18014	1.8%
22.8	17943	1.8%
5	17721	1.8%
11.7	17356	1.7%
14.4	17052	1.7%
0	16966	1.7%
Other values (509)	826211	81.7%

Value	Count	Frequency (%)
-35	2	< 0.1%
-34.7	1	< 0.1%
-34.6	4	< 0.1%
-34.4	5	< 0.1%
-34	3	< 0.1%
-33	7	< 0.1%
-32.7	24	< 0.1%
-32.6	5	< 0.1%
-32.3	10	< 0.1%
-32.1	4	< 0.1%

Value	Count	Frequency (%)
26.1	25	< 0.1%
25.6	317	< 0.1%
25	1675	0.2%
24.4	4823	0.5%
24	68	< 0.1%
23.9	10911	1.1%
23.3	16354	1.6%
23	60	< 0.1%
22.9	7	< 0.1%
22.8	17943	1.8%

precip_depth_1_hr
Real number (ℝ)

Missing Zeros

Distinct	128
Distinct (%)	< 0.1%
Missing	187335
Missing (%)	18.5%
Infinite	0
Infinite (%)	0.0%
Mean	0.80480528

Minimum	-1
Maximum	343
Zeros	725745
Zeros (%)	71.8%
Negative	54836
Negative (%)	5.4%
Memory size	7.7 MiB

Quantile statistics

Minimum	-1
5-th percentile	-1
Q1	0
median	0
Q3	0
95-th percentile	3
Maximum	343
Range	344
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	7.5077527
Coefficient of variation (CV)	9.3286574
Kurtosis	504.16716
Mean	0.80480528
Median Absolute Deviation (MAD)	0
Skewness	18.874581
Sum	662733
Variance	56.36635
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	725745	71.8%
-1	54836	5.4%
3	12663	1.3%
5	5938	0.6%
8	3668	0.4%
10	3092	0.3%
13	2146	0.2%
2	1659	0.2%
15	1650	0.2%
18	1490	0.1%
Other values (118)	10583	1.0%
(Missing)	187335	18.5%

Value	Count	Frequency (%)
-1	54836	5.4%
0	725745	71.8%
2	1659	0.2%
3	12663	1.3%
4	106	< 0.1%
5	5938	0.6%
6	128	< 0.1%
7	304	< 0.1%
8	3668	0.4%
9	50	< 0.1%

Value	Count	Frequency (%)
343	5	< 0.1%
340	12	< 0.1%
333	8	< 0.1%
310	13	< 0.1%
262	19	< 0.1%
257	8	< 0.1%
241	8	< 0.1%
239	20	< 0.1%
236	7	< 0.1%
234	8	< 0.1%

sea_level_pressure
Real number (ℝ)

Missing

Distinct	703
Distinct (%)	0.1%
Missing	61585
Missing (%)	6.1%
Infinite	0
Infinite (%)	0.0%
Mean	1016.0848

Minimum	968.2
Maximum	1045.5
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	968.2
5-th percentile	1004.8
Q1	1011.6
median	1016
Q3	1020.5
95-th percentile	1027.7
Maximum	1045.5
Range	77.3
Interquartile range (IQR)	8.9

Descriptive statistics

Standard deviation	7.0703059
Coefficient of variation (CV)	0.006958382
Kurtosis	1.1204145
Mean	1016.0848
Median Absolute Deviation (MAD)	4.4
Skewness	-0.10130335
Sum	9.6448797 × 10⁸
Variance	49.989225
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1015.2	6337	0.6%
1016.2	6196	0.6%
1016.1	6167	0.6%
1015.8	6066	0.6%
1015.9	6028	0.6%
1016.4	6006	0.6%
1016	6004	0.6%
1017.7	5978	0.6%
1015	5855	0.6%
1014.5	5846	0.6%
Other values (693)	888737	87.9%
(Missing)	61585	6.1%

Value	Count	Frequency (%)
968.2	2	< 0.1%
968.3	3	< 0.1%
968.8	5	< 0.1%
969.4	2	< 0.1%
969.9	1	< 0.1%
970.8	2	< 0.1%
971.6	2	< 0.1%
971.9	1	< 0.1%
972.9	1	< 0.1%
973.3	4	< 0.1%

Value	Count	Frequency (%)
1045.5	1	< 0.1%
1045.4	8	< 0.1%
1045.3	3	< 0.1%
1045.2	8	< 0.1%
1044.9	9	< 0.1%
1044.7	3	< 0.1%
1044.6	4	< 0.1%
1044.5	8	< 0.1%
1044.3	8	< 0.1%
1043.9	4	< 0.1%

wind_direction
Real number (ℝ)

Missing Zeros

Distinct	43
Distinct (%)	< 0.1%
Missing	72221
Missing (%)	7.1%
Infinite	0
Infinite (%)	0.0%
Mean	173.26702

Minimum	0
Maximum	360
Zeros	118183
Zeros (%)	11.7%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	80
median	180
Q3	280
95-th percentile	340
Maximum	360
Range	360
Interquartile range (IQR)	200

Descriptive statistics

Standard deviation	114.05568
Coefficient of variation (CV)	0.65826537
Kurtosis	-1.2441902
Mean	173.26702
Median Absolute Deviation (MAD)	100
Skewness	-0.076811351
Sum	1.6262565 × 10⁸
Variance	13008.698
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=43)

Value	Count	Frequency (%)
0	118183	11.7%
170	32162	3.2%
300	31399	3.1%
290	29655	2.9%
310	28665	2.8%
180	28545	2.8%
270	27816	2.8%
160	27690	2.7%
320	27437	2.7%
190	26862	2.7%
Other values (33)	560170	55.4%
(Missing)	72221	7.1%

Value	Count	Frequency (%)
0	118183	11.7%
10	16852	1.7%
20	16100	1.6%
30	15516	1.5%
40	14461	1.4%
50	15043	1.5%
60	17730	1.8%
70	20714	2.0%
80	21606	2.1%
84	3	< 0.1%

Value	Count	Frequency (%)
360	21139	2.1%
350	24158	2.4%
340	23899	2.4%
330	25023	2.5%
320	27437	2.7%
310	28665	2.8%
300	31399	3.1%
290	29655	2.9%
280	26396	2.6%
270	27816	2.8%

wind_speed
Real number (ℝ)

Zeros

Distinct	58
Distinct (%)	< 0.1%
Missing	7157
Missing (%)	0.7%
Infinite	0
Infinite (%)	0.0%
Mean	3.3820312

Minimum	0
Maximum	19
Zeros	118759
Zeros (%)	11.7%
Negative	0
Negative (%)	0.0%
Memory size	7.7 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	2.1
median	3.1
Q3	4.6
95-th percentile	7.7
Maximum	19
Range	19
Interquartile range (IQR)	2.5

Descriptive statistics

Standard deviation	2.2659987
Coefficient of variation (CV)	0.67001118
Kurtosis	1.1418642
Mean	3.3820312
Median Absolute Deviation (MAD)	1.5
Skewness	0.81369787
Sum	3394368.8
Variance	5.13475
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	118759	11.7%
2.1	116156	11.5%
2.6	109783	10.9%
1.5	104188	10.3%
3.1	99240	9.8%
3.6	88430	8.7%
4.1	72200	7.1%
4.6	60710	6.0%
5.1	48062	4.8%
5.7	39090	3.9%
Other values (48)	147030	14.5%

Value	Count	Frequency (%)
0	118759	11.7%
0.5	1950	0.2%
1	4257	0.4%
1.3	21	< 0.1%
1.5	104188	10.3%
1.6	5	< 0.1%
2	1163	0.1%
2.1	116156	11.5%
2.2	46	< 0.1%
2.6	109783	10.9%

Value	Count	Frequency (%)
19	6	< 0.1%
18.5	4	< 0.1%
18	5	< 0.1%
17	21	< 0.1%
16.5	14	< 0.1%
16	66	< 0.1%
15.4	80	< 0.1%
15	27	< 0.1%
14.9	87	< 0.1%
14.4	131	< 0.1%

year
Categorical

Constant

Distinct	1
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	7.7 MiB

2016	1010805

Length

Max length	4
Median length	4
Mean length	4
Min length	4

Characters and Unicode

Total characters	4043220
Distinct characters	4
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	2016
2nd row	2016
3rd row	2016
4th row	2016
5th row	2016

Common Values

Value	Count	Frequency (%)
2016	1010805	100.0%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
2016	1010805	100.0%

Most occurring characters

Value	Count	Frequency (%)
2	1010805	25.0%
0	1010805	25.0%
1	1010805	25.0%
6	1010805	25.0%

Most occurring categories

Value	Count	Frequency (%)
(unknown)	4043220	100.0%

Most frequent character per category

(unknown)

Value	Count	Frequency (%)
2	1010805	25.0%
0	1010805	25.0%
1	1010805	25.0%
6	1010805	25.0%

Most occurring scripts

Value	Count	Frequency (%)
(unknown)	4043220	100.0%

Most frequent character per script

(unknown)

Value	Count	Frequency (%)
2	1010805	25.0%
0	1010805	25.0%
1	1010805	25.0%
6	1010805	25.0%

Most occurring blocks

Value	Count	Frequency (%)
(unknown)	4043220	100.0%

Most frequent character per block

(unknown)

Value	Count	Frequency (%)
2	1010805	25.0%
0	1010805	25.0%
1	1010805	25.0%
6	1010805	25.0%

	air_temperature	building_id	cloud_coverage	dew_temperature	floor_count	meter	meter_reading	precip_depth_1_hr	primary_use	sea_level_pressure	site_id	square_feet	wind_direction	wind_speed	year_built
air_temperature	1.000	-0.297	0.121	0.730	-0.221	0.080	0.019	0.050	0.046	-0.320	-0.299	-0.011	-0.097	-0.057	0.184
building_id	-0.297	1.000	-0.239	-0.117	-0.579	0.317	0.136	-0.041	0.224	0.074	0.994	0.141	0.058	0.005	-0.315
cloud_coverage	0.121	-0.239	1.000	0.168	-0.123	0.130	-0.050	-0.035	0.076	-0.147	-0.241	-0.088	0.055	0.237	0.082
dew_temperature	0.730	-0.117	0.168	1.000	-0.186	0.080	0.025	0.066	0.043	-0.192	-0.118	-0.045	-0.165	-0.124	0.131
floor_count	-0.221	-0.579	-0.123	-0.186	1.000	0.219	0.446	0.023	0.204	-0.047	-0.596	0.630	0.091	0.006	0.006
meter	0.080	0.317	0.130	0.080	0.219	1.000	0.018	0.008	0.122	0.058	0.278	0.117	0.066	0.057	0.118
meter_reading	0.019	0.136	-0.050	0.025	0.446	0.018	1.000	0.002	0.003	-0.013	0.135	0.499	-0.018	-0.042	0.130
precip_depth_1_hr	0.050	-0.041	-0.035	0.066	0.023	0.008	0.002	1.000	0.005	-0.021	-0.041	0.006	-0.035	-0.036	0.027
primary_use	0.046	0.224	0.076	0.043	0.204	0.122	0.003	0.005	1.000	0.026	0.205	0.151	0.034	0.027	0.172
sea_level_pressure	-0.320	0.074	-0.147	-0.192	-0.047	0.058	-0.013	-0.021	0.026	1.000	0.074	-0.047	-0.095	-0.176	-0.004
site_id	-0.299	0.994	-0.241	-0.118	-0.596	0.278	0.135	-0.041	0.205	0.074	1.000	0.140	0.059	0.005	-0.321
square_feet	-0.011	0.141	-0.088	-0.045	0.630	0.117	0.499	0.006	0.151	-0.047	0.140	1.000	-0.017	-0.050	0.123
wind_direction	-0.097	0.058	0.055	-0.165	0.091	0.066	-0.018	-0.035	0.034	-0.095	0.059	-0.017	1.000	0.420	-0.060
wind_speed	-0.057	0.005	0.237	-0.124	0.006	0.057	-0.042	-0.036	0.027	-0.176	0.005	-0.050	0.420	1.000	-0.037
year_built	0.184	-0.315	0.082	0.131	0.006	0.118	0.130	0.027	0.172	-0.004	-0.321	0.123	-0.060	-0.037	1.000

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

	building_id	meter	timestamp	meter_reading	site_id	primary_use	square_feet	year_built	floor_count	air_temperature	cloud_coverage	dew_temperature	precip_depth_1_hr	sea_level_pressure	wind_direction	wind_speed	year
0	215	1	2016-06-11 15:00:00	103.3250	2	Lodging/residential	36406	1940.0	NaN	28.9	2.0	16.1	0.0	1011.0	80.0	3.6	2016
1	1329	2	2016-01-16 15:00:00	254.2530	15	Technology/science	60100	1912.0	NaN	2.8	NaN	2.2	NaN	998.8	230.0	2.1	2016
2	108	0	2016-01-18 23:00:00	194.0000	1	Education	81580	1913.0	5.0	0.0	0.0	-3.6	NaN	1015.5	50.0	1.5	2016
3	271	0	2016-04-21 02:00:00	45.9100	2	Education	71421	NaN	NaN	32.2	4.0	-8.3	0.0	1007.9	300.0	3.1	2016
4	1107	0	2016-07-29 23:00:00	576.6570	13	Education	184098	NaN	NaN	25.6	2.0	10.6	0.0	1016.5	10.0	4.1	2016
5	1226	2	2016-05-14 18:00:00	0.4246	14	Education	27995	NaN	NaN	22.8	4.0	9.4	0.0	1004.4	230.0	6.2	2016
6	1157	0	2016-04-29 08:00:00	141.1250	13	Education	37107	NaN	NaN	1.7	2.0	1.1	0.0	1021.6	20.0	2.1	2016
7	228	1	2016-01-03 14:00:00	96.4320	2	Lodging/residential	49108	1951.0	NaN	11.7	2.0	0.0	0.0	1018.1	90.0	3.6	2016
8	903	1	2016-09-09 11:00:00	2022.0800	9	Education	275793	NaN	NaN	25.0	0.0	23.3	0.0	1012.5	NaN	2.1	2016
9	989	1	2016-05-31 11:00:00	340.2900	9	Education	168696	NaN	NaN	23.9	NaN	22.2	0.0	1011.4	NaN	1.5	2016

	building_id	timestamp	meter_reading	site_id	primary_use	square_feet	year_built	floor_count	air_temperature	cloud_coverage	dew_temperature	precip_depth_1_hr	sea_level_pressure	wind_direction	wind_speed	year
1010795	1115	2016-01-12 07:00:00	32.295	13	Services	42028	NaN	NaN	-17.2	2.0	-21.1	-1.0	1014.2	320.0	8.2	2016
1010796	192	2016-09-02 20:00:00	722.990	2	Education	151637	1983.0	NaN	37.8	4.0	15.0	0.0	1007.4	NaN	3.1	2016
1010797	963	2016-11-08 14:00:00	22.000	9	Lodging/residential	44784	NaN	NaN	17.8	0.0	17.2	0.0	1020.9	0.0	0.0	2016
1010798	129	2016-02-21 23:00:00	127.300	1	Lodging/residential	102957	1968.0	7.0	11.7	NaN	10.1	NaN	1008.0	230.0	10.3	2016
1010799	1080	2016-03-09 22:00:00	412.713	13	Education	207115	NaN	NaN	5.0	NaN	1.7	0.0	1014.6	210.0	3.6	2016
1010800	468	2016-05-05 13:00:00	69.720	3	Office	40000	NaN	NaN	10.6	NaN	9.4	-1.0	1004.9	30.0	4.6	2016
1010801	863	2016-07-10 12:00:00	113.625	8	Public services	19823	NaN	1.0	27.8	2.0	23.9	0.0	1018.6	0.0	0.0	2016
1010802	1141	2016-04-11 07:00:00	22.000	13	Parking	20986	NaN	NaN	1.1	NaN	-7.8	0.0	1011.2	300.0	4.6	2016
1010803	658	2016-05-02 03:00:00	3.200	5	Entertainment/public assembly	31075	1976.0	2.0	11.0	0.0	10.0	NaN	NaN	220.0	2.1	2016
1010804	552	2016-03-07 02:00:00	9.450	3	Public services	20110	1936.0	NaN	5.6	NaN	0.6	0.0	1026.4	170.0	1.5	2016

Overview

Variables

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

(unknown)

Most occurring scripts

Most frequent character per script

(unknown)

Most occurring blocks

Most frequent character per block

(unknown)

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

(unknown)

Most occurring scripts

Most frequent character per script

(unknown)

Most occurring blocks

Most frequent character per block

(unknown)

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

(unknown)

Most occurring scripts

Most frequent character per script

(unknown)

Most occurring blocks

Most frequent character per block

(unknown)

Interactions

Correlations

Missing values

Sample